A Multilayer Convolutional Encoder | 您所在的位置:网站首页 › encoder-decoder attention › A Multilayer Convolutional Encoder |
来自
arXiv.org
喜欢
0
阅读量: 509 作者: S Chollampatt,HT Ng 展开 摘要: We improve automatic correction of grammatical, orthographic, and collocation errors in text using a multilayer convolutional encoder-decoder neural network. The network is initialized with embeddings that make use of character N-gram information to better suit this task. When evaluated on common benchmark test data sets (CoNLL-2014 and JFLEG), our model substantially outperforms all prior neural approaches on this task as well as strong statistical machine translation-based systems with neural and task-specific features trained on the same data. Our analysis shows the superiority of convolutional neural networks over recurrent neural networks such as long short-term memory (LSTM) networks in capturing the local context via attention, and thereby improving the coverage in correcting grammatical errors. By ensembling multiple models, and incorporating an N-gram language model and edit features via rescoring, our novel method becomes the first neural approach to outperform the current state-of-the-art statistical machine translation-based approach, both in terms of grammaticality and fluency. 展开 关键词: Computer Science - Computation and Language DOI: 10.48550/arXiv.1801.08831 被引量: 16 年份: 2018 |
CopyRight 2018-2019 实验室设备网 版权所有 |